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Abstract 

The low-temperature phase of discontinuous mean-field spin glasses is generally described 
by a one-step replica symmetry breaking (1RSB) Ansatz. The Gardner transition, i.e. a very- 
low-temperature phase transition to a full replica symmetry breaking (FRSB) phase, is often 
regarded as an inessential, and somehow exotic phenomenon. In this paper we show that the 
metastable states which are relevant for the out-of-equilibrium dynamics of such systems are 
always in a FRSB phase. The only exceptions are (to the best of our knowledge) the p-spin 
spherical model and the random energy model (REM). We also discuss the consequences of 
our results for aging dynamics and for local search algorithms in hard combinatorial problems. 



*UMR 8549, Unite Mixte de Recherche du Centre National de la Recherche Scientifique et de 1' Ecole Normale 
Superieure. 
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Figure 1: The complexity curve for a generic discontinuous mean-field spin glass. The dashed line 
is the 1RSB approximation, while the continuous line is the exact result. The two coincide below 
/g- The gray region is FRSB. The shape of the Parisi order parameter is shown in the insets. 



During the last decade the p-spin spherical spin glass has been thoroughly investigated both 
in its statical and in its dynamical behavior ^QEJEISI • In fact this model is usually considered 
the prototypical example of discontinuous mean-field spin glasses. The latter, in turn, have 
been argued to be crucial for understanding the structural glass transition [5]. In this paper we 
show that the p-spin spherical model is indeed quite an exceptional case among discontinuous 
mean-field models. While our results do not invalidate the insight gained so far, they add some 
new important feature to the general picture. 

The out-of-equilibrium dynamics of the p-spin spherical models is closely related to the 
structure of metastable states (Hj. Below the dynamical temperature T^, the Gibbs measure 
decomposes among an exponential number of metastable states, whose free-energy densities 
lie between two values / s and fd- The relevant quantity in this regime is the complexity (or 
configurational entropy) This is defined in terms of the number Mx{f) of metastable 

states having free energy density /, 



N being the number of degrees of freedom of the system. is strictly positive between 

f s and /d, with an absolute maximum at fd- The free-energy density f*(T) of the pure states 
which dominate the Gibbs measure, results from the balance between energetic and entropic 
considerations. While the former would privilege the states at / s , the latter favor the states 
at / d . 

On the other hand, in a typical out-of-equilibrium set up, the system is rapidly cooled 
below Td from its high-temperature phase [3]. In the thermodynamic limit, the system never 
equilibrates and its behavior is dominated by the most numerous metastable states, i.e. the 
ones at fd- This means that, for any single-time observable 0(t), the following identity holds 



1 Introduction and main results 



NtU) ~ exp{JVE r (/)} 
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where the average on the left-hand side is taken with respect to thermal histories, while 
on the right-hand side it is taken with respect to a constrained Gibbs measure. Outside 
the thermodynamic limit, the system eventually equilibrates on an exponential time scale 

terg(iV) = exp{0(iV)}. 

The complexity Sy(/) can be calculated within a 1RSB scheme T. This calculation is 
known to be correct for the p-spin spherical model pQ. This does not rule out the possibility 
of further replica-symmetry breakings for more general cases: one would then expect a FRSB 
calculation to be necessary. The consequences of FRSB on the above picture have not been 
investigated so far. However, it is usually thought that FRSB would play a minor role. The 
intuition, as far as we can understand it, goes as follows. As shown in 1984 by Elisabeth 
Gardner ,8, in the case of the p-spin Ising model, discontinuous spin glasses may have a 
FRSB phase which overcomes the 1RSB phase at very low temperature. The common wisdom 
associates low temperature to low energy: if any FRSB effect is present, it affects, at most, 
the lowest part of the complexity spectrum. As a consequence, out-of-equilibrium dynamics 
is unaffected by FRSB. Here we show that this intuition is incorrect and that FRSB plays an 
important role also for discontinuous mean-field glasses. 

The correct scenario is sketched in Fig. ^ The 1RSB solution is stable with respect to 
FRSB up to some value Jq of the free-energy density. At higher free energies, the 1RSB 
solution becomes unstable and a FRSB calculation is required. Quite generally /g < fd 
strictly. We know just two exceptions to this rule (both are somehow degenerate cases): the 
spherical model and the REM [Sj. On the contrary both the situations /g < / s and /g > / s 
are possible. A thermodynamic FRSB phase transition occurs when Jq crosses /*(T). Above 
/g, the FRSB calculation will give a new complexity curve, and, in particular a new threshold 
free energy fL Of course, out-of-equilibrium dynamics will be dominated (in the sense of Eq. 
(|1.2j0 by the states at f' d . Finally, also the nature of aging dynamics will change. We expect 
relaxation to be characterized by an infinite number of time sectors |10| lll| (instead of just 
two) , although two of them will be most relevant (namely the first and the last one) . 

In the next Sections we shall illustrate the general scenario with two examples which are, 
at the same time, simple and representative. In Sec. |2] we reconsider the fully-connected 
Ising p-spin model. The simplicity of this example allows us to study the problem at finite 
temperatures. In Sec.|3]we turn to finite connectivity models at zero temperature. In this case 
we can compare our results with numerical simulations. 



2 Infinite connectivity 

The fully-connected p-spin model is defined by the Hamiltonian 

(h—ip) 

where the iV variables Oi = ±1 are Ising spins and the Ji 1 i 2 ...i p are quenched random inter- 
actions extracted from a Gaussian distribution with zero mean and variance p\/(2N p ^ 1 ). For 
illustration we shall often consider the p = 3 case, although our results are qualitatively valid 
for any finite p > 2. 

Using the standard replica formalism with a 1RSB Ansatz, one obtains the action [S] 
( f ) ({3,m)=-^\l + {p-l){l-m)q p -pq p - 1 } -i log 2--^ log fvz cosh m (J5\ z) , (2.2) 
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Figure 2: 3-spin fully-connected Ising model: the Parisi parameter m for thermodynamic states 
(dotted-dashed curve) and for threshold states (dashed curve) as a function of the temperature. In 
the shaded region, 1RSB solutions are unstable with respect to further replica symmetry breakings. 



where Vz = e z I 2 dz/\/27r, A = w | qP 1 and q is determined by the saddle point equation 

JVz cosh m (/3Az)tanh 2 (/?Az) 



fVz cosh m (p\z 



(2.3) 



From the action (j2,2[) we have the usual parametric representation [Jj of the complexity S^(/) 
at temperature T = 1/(3: 

S = /?m 2 d m <M/?, m) , / = a m [m 0(/3, m)] . (2.4) 

The outcome of this formulae agrees with the general picture sketched in Fig. ^ that is Sy(/) 
is positive for / E [/ s , /J, which corresponds to m G [m s , mj. Both the extrema of this range 
depend on the temperature. The internal energy of metastable states can be calculated using 
the identity 

e(P,m) = -^= Yl J hi2-i P {cri 1 cr i2 ...a ip ) =~ 1 - (1 - m) q p , (2.5) 
(u,.~ ,ip) 

where q satisfies Eq. (|2.3|) . 

The thermodynamics of the model at temperature T (within the 1RSB approximation) 
is obtained maximizing (j)(T,m) with respect to m G [0, 1]. The resulting m s (T) is shown in 
Fig- 12 (dotted-dashed curve): it becomes smaller than 1 at the critical temperature T s and it 
vanishes for T — > as m s ~ f-t B T- Threshold states, those maximizing the complexity E, are 
obtained fixing m = m&(T), which is shown in Fig. I^Jwith a dashed curve: m&{T) becomes 
smaller than 1 at the dynamical critical point and vanishes as ~ HdT. 

The stability of the 1RSB solution with respect to a second step (and eventually infinite 
steps) of replica symmetry breaking can be evaluated following Ref. jHj- For any given T and 
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m the 1RSB solution is stable provided 



fVz cosh m - 4 (/3Az 
p(p - l)p 2 qP- 2 " JVz cosh m (/3 Xz) 



> 



(2.6) 



In Fig.|2]the region where replica symmetry should be broken more than once has been shaded. 
We call itiq(T) its boundary. In Ref. jSj Elizabeth Gardner calculated the critical point Tq 
where thermodynamic states are no longer 1RSB (this point was called T 2 in Ref. jHJ). Still 
more interesting is the fact that threshold states are always in the unstable region. 

The physical scenario already described in Sec. ^ (see Fig. ^) is confirmed for any temper- 
ature below Tfj. In general we find that fc is strictly less than /j, while both the inequalities 
/g < f s and /g > f s are possible, depending on the temperature. For / < /g the 1RSB 
solution is correct and the Parisi order parameter q(x) has a single step at x = m (see lower 
inset in Fig. ^ an d please remind that in the absence of an external field qo = 0). For f > fc, 
the FRSB calculation will give an order parameter q(x) with a continuous non-trivial part 
above the step (see upper inset in Fig. a new complexity curve and, in particular, a new 
threshold free energy fL The geometrical structure of metastable states above /g is therefore 
the following. There is an exponential number of families of states, each one having a FRSB 
structure inside. The typical overlap between two families is 0, while the minimum overlap 
between states of the same family is given by the step size in the function q(x). 

Let us suggest a natural generalization of the above method, for computing £(/) above 
/g- Given the free-energy functional J2] $frsb[T", q(x)], one can parameterize q(x) by the 
jump location m and by the continuous function r(x) for x £ [m, 1]. Then one can define 
<p(T,m) = max r (j,j ^FRSBp -1 , q( x )]i by maximizing the free-energy functional for fixed T and 
m 1 . Finally the complexity is obtained by taking the Legendre transform of <j)(T, m) as in Eq. 
(|2,4|) . The complete calculation can be done using e.g. the numerical method of Ref. |13j . Here 
we show the result of a 2RSB approximated calculation at zero temperature. 

In the T — > limit, the 1RSB free energy is simply given by 



4 R . s o B (f) 



-e-Iio 
4 fi 



1 + erf 1 ^-/i 



(2.7) 



2 J^dte <2 /VtF- The resulting complexity S(e) is shown 



where [i = lim^oo (3m and erf (x) 
in Fig. El (dashed curve). 

The 2RSB free energy ^?fo^(/-ti, ^2) depends on two numbers which parameterize, as in the 
1RSB case, the zero temperature limit of the Parisi breaking parameters. The three overlaps 
behaves as follows: go = 0, q\ = q (with < q < 1 strictly) and q2 — 1 — u>T. The saddle 
point equation for q reads 



fvz i^ 2 (z, q ,fi 2 ) il&q,^) 



I±(z,q,fi 2 ) 



JVzI^(z,q,^ 2 ) 



, + aT ( ^ - ^ 
2 rj 



^This means that one has to maximize 'I'frsbP 1 , q(x)] among all the order parameters q(x) such that q(x) = for 
x < to. Let us call toJ rsb the position of the discontinuity in the statical FRSB solution q s (x). If to < TO,f RSB , there 
is one trivial solution to this maximization problem: q(x) — q s (x). We expect a non-trivial secondary maximum to 
exist. On such a maximum the discontinuity in q(x) is located at m. This expectation is indeed confirmed by our 
2RSB calculation. 



5 



0.07 
0.06 
0.05 
0.04 
0.03 
0.02 
0.01 


-0.82 -0.81 -0.8 -0.79 -0.78 -0.77 -0.76 -0.75 

f=e 

Figure 3: T = complexity as a function of the (free) energy density for the 3-spin fully-connected 
Ising model, obtained with 1RSB and 2RSB approximations. 
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where v = \i\ / /j, 2 , A = J | q p 1 and r/ = \Jp(\ 
for the action and the energy simplify to 



,p-l> 



At the saddle point, the expressions 



0(^1,^2) 

e(/ii,Ai 2 ) 



' 4 L 
1 



l + (p-l)(l-^-p/- ] 



Ml 



2 L J 

2 .^/u^-HVi-r 1 ,?, 

-6 4 ^ 



M2j 



7rp 



JVzI$(z,q,» 2 ) 



In IVzI^z,q,fi 2 ) , (2.10) 

(2.11) 

(2.12) 



where, as usual, g satisfies the saddle point equation (|2.8|) . In the interesting region of pa- 
rameters the shape of ^>{(jl\, fjL 2 ) is that of 2 com-penetrating paraboloids (see Fig. 0J): On the 
left paraboloid we have that q = and we recover the 1RSB solution with fj, = fi 2 , while on 
the right paraboloid q takes non-trivial values and we find there the absolute maximum of 
tj>(jj>i, fJ> 2 ), corresponding to the ground state energy. Please note that, on the right paraboloid, 
the most relevant variable is the smaller breaking parameter m. 

We proceed by maximizing (f)(fj,i, fx 2 ) over fi 2 , and Legendre-transforming the result with 
respect to fi\. The result is shown in Fig. |3] (continuous line). It is worth mentioning at least 
two important facts: 

• The 2RSB threshold energy e^ RSB is much lower than the 1RSB one e^ 36 . 

• In the region between eg RSB and e^ RSB the complexity curve does not change significantly. 
In general we expect S(e) not to change below ec, but in this case cq < eg RSB . 

How does this new physical scenario affect observable quantities, like the internal energy? 
In the main panel of Fig. \E\ we plot the thermodynamic energy e s (T), the threshold states 
energy ed(T), and the internal energy ec(T) at the instability point, for the fully-connected 
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Figure 4: Replicated free-energy for the 3-spin fully-connected Ising model at T = as a function 
of the breaking parameters. The bold line is the result of a maximization over fx 2 & t fixed It 
ends on the border of the region with q = (left paraboloid). Notice that the trivial maximum in 
this region has to be discarded when computing the complexity, since it has ^2) = 0. 




Figure 5: Thermodynamic energy (dotted-dashed line) and threshold energy (dashed line) as a 
function of the temperature within the 1RSB approximation. States above the full line are unsta- 
ble with respect to further replica symmetry breakings. The arrows mark the threshold energies 
calculated directly at T = 0. Main panel: 3-spin fully-connected Ising model. Inset: pictorial view 
for a 3-spin with small connectivity. 
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3-spin model. The incorrectness of the 1RSB Ansatz for threshold states is clear from the 
unphysical behavior of e^(T), which is not a monotonously increasing function of T: an an- 
nealing experiment with a very slow cooling, following 1RSB threshold states, would produce 
an increase of energy when temperature is decreased! 

The energy obtained with an extremely slow cooling, i.e. that of threshold states, must 
lie below ed(T) and above both e s (T) and bq(T), and it must be a monotonously increasing 
function of T. We can estimate ed(T = 0), from the zero-temperature 2RSB calculation above. 
The result is marked by an arrow in Fig. El As already noticed, this value is much lower than 
what predicted by an 1RSB calculations. Such a conclusion has positive consequences on the 
use of simulated annealing and related techniques for the search of low energy solutions in 
hard combinatorial problems. 

However, the situation is not always like the one just described. In some cases, ec(T) > 
e s (T) for all temperatures below (see the sketch in the inset of Fig. EJ). This is what actually 
happens for p-spin models with small connectivities, as will be shown in the next Section. 



3 Finite connectivity and numerical simulations 

Finite connectivity mean-field models have been the object of intense investigation in the last 
years. On one hand, they are thought to share some properties of finite-dimensional models 
(namely each spin interact with a finite number of neighbors). On the other hand, they are 
closely related to extremely hard combinatorial optimization problems |14j . Nevertheless, up to 
now, the theoretical investigations have been limited to the 1RSB level |15U16j . Here we want 
to show how the 1RSB phase becomes unstable with respect to 2RSB fluctuations, and how 
to compute the stability threshold. We expect that, as usual, once the 1RSB phase becomes 
unstable, FRSB has to be used for properly describing the system. 

For sake of simplicity, we present our calculation in a particularly simple case, which allows 
a fully explicit derivation. We shall comment later on the generalizations of our results. To 
be definite, let us consider a fixed-connectivity Ising model with p-spin interactions (hereafter 
p > 2) with Hamiltonian 

W(<r) = - ^2 Jh-ipVii ■ ■ ■ ■ (3- 1 ) 

(ii—ip)eS 

In the above formula Q is the hypergraph of interactions, i.e. a set of M among the ( iV ) 
possible p-uples of the N spins. Here we shall take Q to have fixed connectivity: each spin is 
supposed to participate to (I + 1) interaction terms. Finally we shall consider the couplings 
Jii...i p to take the values ±1 with equal probability. 

Under these hypothesis the 2RSB order parameter is a normalized measure on a space of 
probability distributions and does not depend upon the site of the sample |T7] . The mean-field 
equations are most conveniently written in terms of two such measures: Q[p] and Q[p\. At 
zero temperature they have the form 

/ 



q is = \ /n^ Q) ] z [^ Q) }] Mi//i2 4£-^ (o) ^ a) }]l > ( 3 - 2 ) 

^ J a=l 

Qig = jndQlpV}5[p-^[{p^}}\ , (3.3) 
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where Z is a normalization constant and < p\ < p2 < 00 are the 2RSB parameters in the (3 — > 
00 limit. The probability distribution p is supported over the integers q such that — 1 < q < +1. 
It is therefore given in terms of three positive numbers: p = {p+, po, P-} (with p + +po+P- = !)• 
The distribution p is instead supported over the integers —l<q<L However, for our 
purposes, we can parametrize it using the three numbers {p + = Y2 q =i P<n P01P- = J2ql-i Pq\- 
The "functionals" Q[p] and Q[p] are therefore nothing but distributions over two-dimensional 

simplexes. Finally, the functions p^[. ■ ■ ] and p^°'[. ■ ■ ] entering in Eqs. ()3.2|) - (j3.3j) are defined 
as follows: 



P+A- 



1 



£g Q >0,=0,<0 



II p£° ■ ex P 



-fJ-2 



.a=l 



a=l 



(3.4) 



( 1 

2 



pf ] 



u^( P f+p^)+m=K^-p^) 



i-nr=i(p?+p^ 



El(pf+P B )-n^-^) 



if q = + , 
if g = , 
if g = - , 



(3.5) 



and the constant .z[{/5^}] is such that p^ is normalized. 

The authors of Ref. considered the 1RSB solution to this problem. This is nothing but 
the fixed point (p*,p*) of Eqs. (jS3J) and (l3~5j) : 



P 



P i0) [p\ 



,P 



P 



(3.6) 



The above equations have always a symmetric solution: p* + = p*_, p+ = pi, which is the 
physical one. The physical stability of the 1RSB phase coincides with the stability of this 
solution under the iteration ()3.2|) - (|3.3j) . We must therefore consider how the 2RSB order 
parameters Q[p], Q[p] can reduce to the 1RSB solution 1)3.6(1 : 



• The first possibility is that Q[p] and Q[p] concentrate around p* , p*: 

Q[p]^f(p-p*), S[p]~/(p-p*), 



(3.7) 



where /(•) and /(•) are supported in a neighborhood of 0. The two distributions on the 
two-dimensional simplex Q, Q tend, in the 1RSB limit, to delta functions in a particular 
point (p*,p*) of the simplex. 

The stability condition of the delta-function solution under perturbations of the type 
(j3.7() is easily derived. Define the 2x2 matrices L and L by linearizing Eqs. ((3.4(1 . ((3. 5(1 
around (p*,p*): 



J Q,Q 



L, 



<J,<7 



P* 



BP? 



for q,q' £ {+,-} ■ 



(31 



If we call Amax the eigenvalue of their product L ■ L having the maximum absolute value, 
we obtain the stability condition 



l(p- 1) • |A M ax| < 1 



(3.9) 
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In fact the matrices L and L can be easily diagonalized by using symmetry considerations: 
one of the two eigenvectors is symmetric, and the other is antisymmetric under the 
exchange + <->—. The antisymmetric eigenvalue vanishes for p > 2. The symmetric one 
can be shown to verify always the stability condition (|3.9j) . This type of instability is 
therefore irrelevant for the problem under study. 

• The second possibility is that the functionals Q[p] and Q[p] concentrate around delta- 
function distributions: 

Q[p] ~ P\f+\p - £f] + pI Hp - §o] + ptf-[p - <L] , (3.10) 

and analogously for Q[p\. In the above expression the distributions f q [-] are supported 
around 0, and 5 + (respectively 5 , S_) is the distribution {1,0,0} (respectively {0, 1,0}, 
{0, 0, 1}). In other words the measures Q[p] and Q[p] concentrate over the corners of the 
simplex, with weights given by the 1RSB solution. 

In order to derive the stability condition it is convenient to use variables which are small 
near the corners of the simplex. One possible choice is to rewrite the distributions f q [-] 
as functions of the variables 

e± = p±- 6 q> ± , (3.11) 

and analogously for the distributions f q [-]. Notice that two variables are sufficient because 
of the normalization constraint. Moreover the signs of e+, e_ are fixed by the value of q. 
It is now easy to linearize the equations for f q [-], f q [] in the limit e± <^ 1. If we define 
(e±) q (respectively (e±) q ), the average of e± (e±) with respect to f q [-] (/§■[■]), we get the 
equations 

(Og ~ 1 ^2 T qa,qB , ~ (p ~ 1) ^ T qS,qa (O? , (3.12) 

qfi 

where the sums over q and q run over {+,0, — }, while the ones over a and a run over 
{+,—}. Explicit formulae for the 6x6 matrices T and T are reported in App. As 
before, we look for the eigenvalue of the product T ■ T which has the largest absolute 
value. If we call wmax this eigenvalue, the stability criterion is 

l{p - 1) • |U; M AX| < 1 ■ (3-13) 

It turns out that wmax depends uniquely on the parameter p2i which can be identified 
as the 1RSB parameter. This criterion, unlike (|3.9|) . has a non-trivial content which we 
shall consider in the following. 

The criterion (|3.13|) select a range of the 1RSB parameter for which the 1RSB solution is 
stable. This range has the form p > pq. Using the relation between p and the energy e of 
metastable states [J], see also the previous Section, one can convert this condition as an energy 
condition of the form e < bq. This confirms our general picture summarized in Fig. ^ 

In Table ^ we exemplify the general situation by considering the case p = 3. In the low 
connectivity regime (/ + 1) < 10 we have e s < eq < strictly: the ground state is correctly 
described by 1RSB while high-lying metastable states are unstable to FRSB. The expected 
temperature dependence of in this regime of connectivities, is sketched in the inset of Fig. 
13 At higher connectivities the ground state becomes unstable too: ec < e s < e&. We know 
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1.42832 
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0.535146 
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0.0427 
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0.49023 
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0.717919 
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0.677627 
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0.445068 


1.8279 


0.663636 
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0.41937 
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0.61494 


2.03932 
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2.03054 
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2.15734 
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2.34567 


0.537826 


2.37296 


0.0339348 


14 


0.337728 


2.2939 
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2.43451 
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2.4566 


0.00375363 


15 


0.320558 


2.38318 
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2.52697 


0.501257 


2.5739 


0.0316323 
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0.311329 


2.45761 
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0.4786 
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0.297566 


2.54079 


0.441831 


2.696 
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2.7631 


0.0296691 


18 


0.290241 


2.61089 


0.428229 


2.77367 


0.453371 


2.83566 


0.00720516 


19 


0.278903 


2.689 


0.414083 


2.855 


0.44808 


2.94261 


0.0279824 


20 


0.272901 


2.75551 


0.40303 


2.9285 


0.432245 


3.01104 


0.00820489 



Table 1: 3-spin with fixed connectivity (I + 1) at T = within the 1RSB approximation: columns 
from 2 to 7, breaking parameter and energy corresponding to threshold (d), thermodynamic (s) 
and marginally-stable (G) states; column 8, 0-component of the 1RSB parameter on the states 
dominating the thermodynamics. 



that the last situation is verified in the infinite-connectivity limit, cf. Sec. [21 Moreover, for 
even connectivities, the instability point corresponds to the vanishing of the 0-component of 
the 1RSB parameter Joq, and thus the ground state become unstable when j5g(// s ) becomes 
positive. 

For (I + 1) < 10, we are in the case depicted in the inset of Fig. |SJ since the instability 
energy eo lies above the ground state energy e s . In this situation there is a lower bound on 
the energy reachable by simulated annealing (and presumably by any local search algorithm 
running in a time polynomial in N) which is strictly above the ground state energy, and the 
problem of finding the ground state is hard and not approximable |18j . 

We have verified this prediction by running long simulated annealings on a large instance 
of the 3-spin model with fixed connectivities 5 and 6. The results are shown in Fig. different 
curves corresponding to different cooling rates. For both connectivities, the energies reachable 
by simulated annealing are clearly below the threshold energy predicted with the 1RSB 
Ansatz. Moreover the extrapolations to infinitely slow cooling rates are perfectly compatible 
with the energy ec, thus suggesting that the complexity coming from the FRSB solution at 
x > m should be tiny. 

Any fixed-connectivity p-spin Ising model is therefore FRSB for what concerns dynamic 
states. Another interesting class of diluted mean-field models consists of models defined on 
random hypergraphs with Poissonian connectivity. Among the others, this class includes 
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Figure 6: 3-spin Ising model with fixed connectivity c, energy relaxation during slow simulated 
annealings. The 4 different full curves correspond to 4 cooling rates proportional to 1,10 -1 ,10 -2 ,10~ 3 . 
The values for ed, ec and e s are those reported in Table [TJ 
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Figure 7: The 1RSB zero-temperature phase diagram for spin models with Poissonian connectivity. 
The shaded area is an educated guess for range of parameter in which FRSB is needed. 
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random 3-SAT QHHaUT] and random p-XORSAT mUniHU. The zero-temperature phase 
diagram for these models in 1RSB approximation is sketched in Fig. Q (we recall that, for both 
these models, energies are always positive defined). Glassy metastable states develop above 
the average connectivity «d and have energy densities between e s (a) and ed(a). The ground 
state energy e s (a) becomes positive at a s (> ay). A quite natural conjecture for the energy 
above which FRSB sets in, ec(«), is reported with a dashed line. We have e s < ec < e<} for 
«d < o < «g, and ec < e s < ea for a > ac- The calculation of the ec(a) curve will be 
presented in a forthcoming publication |25j . 
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A Formulae for the stability matrices 

In this Appendix we give explicit formulae for the matrices T and T implicitly defined by Eq. 
(|3.12j) . All these formulae are expressed in terms of the 1RSB solution, cf. Eq. H3.6JI . The 
form of the matrices is the following: 



t x t 2 t 3 

h 

o u o t 5 

t 5 t 4 

tx 

t 3 t 2 tx 



T 



tx tx 

tx tx 

t 2 t 2 o 

t 2 t 2 o 

tx tx 

tx tx 



(A.l) 



where we ordered the entries in Eq. (|3.12|) as follows: [(e + ) + , (e_) + ; (e+)o, ( e -)o! ( e +)-> ( e -)-]- 
The non-zero entries in the above matrices are given below 



n 



(0) 



(1) 



t 3 



-2^2 ^0 

z A 



(1) 



n 



(0) 



Zn 



n 



(i) 



Zn 



? i P i{i-piy- 2 



2 1 - (1 
where we used the shorthands 



P'o)"-' 



f2 =2 



z 



+,o- = 



(?) 



e hk-^I-^ 

E?.>0;=0.<0 

1-2 ( 

h e n^v ex pj-^ 



Ei^i-iE 1 



(A.2) 
(A.3) 

(A.4) 



+ Ei* 

i 



>E> 



exp 



Mi (|9 + 91-151)] e ik* 

E 9i=9 



-Mi 1^1 



(A.5) 
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Let us finally notice that the +/— symmetry can be exploited to reduce the matrices (IA,1|I to 
3x3 matrices. 
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